Fictitious play in stochastic games

نویسندگان

  • Gijs Schoenmakers
  • János Flesch
  • Frank Thuijsman
چکیده

In this paper we examine an extension of the fictitious play process for bimatrix games to stochastic games. We show that the fictitious play process does not necessarily converge, not even in the 2 × 2 × 2 case with a unique equilibrium in stationary strategies. Here 2 × 2 × 2 stands for 2 players, 2 states, 2 actions for each player in each state.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Stochastic fictitious play with continuous action sets

Continuous action space games form a natural extension to normal form games with finite action sets. However, whilst learning dynamics in normal form games are now well studied, it is not until recently that their continuous action space counterparts have been examined. We extend stochastic fictitious play to the continuous action space framework. In normal form games the limiting behaviour of ...

متن کامل

On the Nonconvergence of Fictitious Play in Coordination Games

It is shown by example that learning rules of the fictitious play type fail to converge in certain kinds of coordination games. Variants of fictitious play in which past actions are eventually forgotten and that incorporate small stochastic perturbations are better behaved for this class of games: over the long run, players coordinate with probability one. Journal of Economic Literature Classif...

متن کامل

Evolution and Learning in Games with Randomly Disturbed Payoffs

We consider four models of evolution and learning in games which rely on perturbations of payoffs, including stochastic fictitious play. In all cases, we establish global stability results for zerosum games, games with an interior ESS, potential games, and supermodular games.

متن کامل

Dynamics in Games

The purpose of the course is to study several dynamics generated by strategic interactions in games. Among the topics are adaptive dynamics in evolutionary game theory, robust procedures for on-line algorithms and stochastic approximation. 1. Fictitious play Discrete time Continuous time and best reply dynamics 2. Replicator dynamics n populations One population Evolutionary Stable Strategies 3...

متن کامل

Dynamic Opponent Modelling in Fictitious Play

Distributed optimisation can be formulated as an n player coordination game. One of the most common learning techniques in game theory is fictitious play and its variations. However fictitious play is founded on an implicit assumption that opponents’ strategies are stationary. In this paper we present a new variation of fictitious play in which players predict opponents’ strategy using a partic...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • Math. Meth. of OR

دوره 66  شماره 

صفحات  -

تاریخ انتشار 2007